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Given two or more processes, the units from which fail in accordance with 
an exponential or delayed exponential law, the problem is to select the partic- 
ular process with the smallest failure rate. It is assumed that there is a com- 
mon guarantee period of zero or positive duration during which no failures 
occur. This guarantee period may be known or unknown. It is desired to 
accomplish the above goal in as short a time as possible without invalidating 
certain predetermined probability specifications. Three statistical techniques 
are considered for reducing the average experiment lime needed to reach a 
decision. 

1 . One technique is to increase the initial number of units put on test. 
This technique will substantially shorten the average experiment time. Its 
effect on the probability of a correct selection is generally negligible and in 
some cases there is no effect. 

2. Another technique is to replace each failure immediately by a new 
unit from the same process. This replacement technique adds to the book- 
keeping of the test, but if any of the popidation variances is large (say in 
comparison with the guarantee period) then this technique will result in a 
substantial saving in the average experiment time. 

3. A third technique is to use an appropriate sequential procedure. In 
many problems the sequential procedure results in a smaller average experi- 
ment time than the best non-sequential procedure regardless of the true 
failure rates. The amount of saving depends principally on the "distance" 
between the smallest and second smallest failure rates. 

For the special case of two processes, tables are given to show the proba- 
bility of a correct selection and the average experiment time for each of three 
types of procedures. 

Numerical estimates of the relative efficiency of the procedures are given 
by computing the ratio of the average experiment lime for two procedures of 
different type with the same initial sample size and satisfying the same 
probability specification. 
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INTRODUCTION 

This paper is concerned with a study of the advantages and disad- 
vantages of three statistical techniques for reducing the average dura- 
tion of life tests. These techniques are: 

1. Increasing the initial number of units on test. 

2. Using a replacement technique. 

3. Using a sequential procedure. 

To show the advantages of each of these techniques, we shall consider 
the problem of deciding which of two processes has the smaller failure 
rate. Three different types of procedures for making this decision will 
be considered. They are: 

Ri , A nonsequential, nonrepla cement type of procedure 
R 2 , A nonsequential, replacement type of procedure 
R 3 , A sequential, replacement type of procedure 
Within each type we will consider different values of n, the initial 
number of units on test for each process. The effect of replacement is 
shown by comparing the average experiment time for procedures of 
type 1 and 2 with the same value of n and comparable probabilities of a 
correct selection. The effect of using a sequential rule is shown by com- 
paring the average experiment time for procedures of type 2 and 3 with 
the same value of n and comparable probabilities of a correct selection. 

ASSUMPTIONS 

1. It is assumed that failure is clearly defined and that failures are 
recognized without any chance of error. 

2. The lifetime of individual units from either population is assumed 
to follow an exponential density of the form 

f{x;e,g) = l -e-*-° )l6 f or x> g 

f(x; 0, g) = for x < g 

where the location parameter g ^ represents the common guarantee 
period and the scale parameter > represents the unknown parameter 
which distinguishes the two different processes. Let 0i ^ 2 denote the 
ordered values of the unknown parameter for the two processes; then 
the ordered failure rates are given by 

Xi = 1/(^1 + g) =s a 2 = 1/(^2 + g) (2) 

3. It is not known which process has the parameter 0i and which has 
the parameter 02 • 
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4. The parameter g is assumed to be the same for both processes. It 
may be known or unknown. 

5. The initial number n of units put on test is the same for both pro- 
cesses. 

6. All units have independent lifetimes, i.e., the test environment is 
not such that the failure of one unit results in the failure of other units 
on test. 

7. Replacements used in the test are assumed to come from the same 
population as the units they replace. If the replacement units have to 
sit on a shelf before being used then it is assumed that the replacements 
are not affected by shelf-aging. 

CONCLUSIONS 

1. Increasing the initial sample size n has at most a negligible effect 
on the probability of a correct selection. It has a substantial effect on the 
average experiment time for all three types of procedures. If the value of 
n is doubled, then the average time is reduced to a value less than or 
equal to half of its original value. 

2. The technique of replacement always reduces the average experi- 
ment time. This reduction is substantial when g = or when the popu- 
lation variance of either process is large compared to the value of g. 
This decrease in average experiment time must always be weighed against 
the disadvantage of an increase in bookkeeping and the necessity of 
having the replacement units available for use. 

3. The sequential procedure enables the experimenter to make rational 
decisions as the evidence builds up without waiting for a predetermined 
number of failures. It has a shorter average experiment time than non- 
sequential procedures satisfying the same specification. This reduction 
brought about by the sequential procedure increases as the ratio a of 
the two failure rates increases. In addition the sequential procedure 
always terminates with a decision that is clearly convincing on the basis 
of the observed results, i.e., the a posteriori probability of a correct 
selection is always large at the termination of the experiment. 

SPECIFICATION OF THE TEST 

Each of the three types of procedures is set up so as to satisfy the 
same specification described below. Let a denote the true value of the 
ratio 0i/0 2 which by definition must be greater than, or equal to, one. 
It turns out that in each type of procedure the probability of a correct 
selection depends on 0i and 0> only through their ratio a. 
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1. The experimenter is asked to specify the smallest value of a (say 
it is a* > 1) that is worth detecting. Then the interval (I, a*) represents 
a zone of indifference such that if the true ratio a lies therein then we 
would still like to make a correct selection, but the loss due to a wrong 
selection in this case is negligible. 

2. The experimenter is also asked to specify the minimum value P* > 
\4 that he desires for the probability of a correct selection whenever 
a ^ a*. In each type of procedure the rules are set up so that the proba- 
bility of a correct selection for a = a* is as close to P* as possible without 
being less than P*. 

The two constants a* > 1 and Yi < P* < 1 are the only quantities 
specified by the experimenter. Together they make up the specification 
of the test procedure. 

EFFICIENCY 

If two procedures of different type have the same value of n and satisfy 
the same specification then we shall regard them as comparable and 
their relative efficiency will be measured by the ratio of their average 
experiment times. This ratio is a function of the true a but we shall 
consider it only for selected values of a, namely, a = 1, a = a* and 



PROCEDURES OF TYPE Ri — NONSEQUENTIAL, NONREPLACEMENT 

"The same number n of units are put on test for each of the two pro- 
cesses. Experimentation is continued until either one of the two samples 
produces a predetermined number r (r ^ n) of failures. Experimenta- 
tion is then stopped and the process with fewer than r failures is chosen 
to be the better one." 



Table I — Probability of a Correct Selection — Procedure 

Type Ri 
(a = 2, any g ^ 0, to be used to obtain r for a* = 2) 



n 


r = 1 


r = 2 


r = 3 


r = 4 


1 


0.667 








— 


2 


0.667 


0.733 


— 


— 


3 


0.667 


0.738 


0.774 


— 


4 


0.667 


0.739 


0.784 


0.802 


10 


0.667 


0.741 


0.789 


0.825 


20 


0.667 


0.741 


0.790 


0.826 


CO 


0.667 


0.741 


0.790 


0.827 



Note: The value for r = is obviously 0.500 for any n. 
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We shall assume that the number n of units put on test is determined 
by non-statistical considerations such as the availability of units, the 
availability of sockets, etc. Then the only unspecified number in the 
above procedure is the integer r. This can be determined from a table 
of probabilities of a correct selection to satisfy any given specification 
(a*, P*). If, for example, a* = 2 then we can enter Table I. If n is 
given to be 4 and we wish to meet the specification a* = 2, P* = 0.800 
then we would enter Table I with n = 4 and select r = 4, it being the 
smallest value for which P ^ P*. 

The table above shows that for the given specification we would also 
have selected r = 4 for any value of n. In fact, we note that the proba- 
bility of a correct selection depends only slightly on n. The given value 
of n and the selected value of r then determine a particular procedure 
of type Ri , say, Ri(n, r). 

The average experiment time for each of several procedures Ri(n, r) 
is given in Table II for the three critical values of the true ratio a, 
namely, a = 1 , a = a* and a = °o . Each of the entries has to be multi- 
plied by 02 , the smaller of the two values, and added to the common 
guarantee period g. For n = oo the entry should be zero (+g) but it 
was found convenient to put in place of zero the leading term in the 
asymptotic expansion of the expectation in powers of 1/n. Hence the 
entry for n = «> can be used for any large n, say, n ^ 25 when r ^ 4. 

We note in Table II the undesirable feature that for each procedure 
the average experiment time increases with a for fixed 2 . For the se- 
quential procedure we shall see later that the average experiment time 
is greater at a = a* than at either a = 1 or a = » . This is intuitively 
more desirable since it means that the procedure spends more time when 
the choice is more difficult to make and less time when we are indifferent 
or when the choice is easy to make. 

PROCEDURES OF TYPE R2 — NONSEQUENTIAL, REPLACEMENT 

"Such procedures are carried out exactly as for procedures of Ri except 
that failures are immediately replaced by new units from the same 
population." 

To determine the appropriate value of r for the specification a* = 2, 
p* = 0.800 when g = we use the last row of Table I, i.e., the row 
marked n = «> , and select r = 4. The probability of a correct selection 
for procedures of type R* is exactly the same for all values of n and de- 
pends only on r. Furthermore, it agrees with the probability for pro- 
cedures of type /2i with n = °o so that it is not necessary to prepare a 
separate table. 
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Tahle III — Value of r Required to Meet the Specification 
(a*, P*) for Procedures of Type R* (g = 0) 
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1 .OS 


1.10 


1.15 


1.20 


1.25 


1.30 


1.35 


1.40 


1.45 



1.50 



2.00 



2.S0 




3.00 


0.50 





























0.55 


14 


4 


2 


2 


1 


1 


1 


1 


1 


1 


1 


1 


1 


0.60 


55 


15 


7 


5 


3 


3 


2 


2 


2 


1 


1 


1 


1 


0.65 


126 


33 


16 


10 


7 


5 


4 


3 


3 


3 


1 


1 


1 


0.70 


232 


61 


29 


17 


12 


9 


7 


6 


5 


4 


2 


1 


1 


0.75 


383 


101 


47 


28 


19 


14 


11 


9 


7 


6 


3 


■1 


1 


0.80 


596 


157 


73 


43 


29 


21 


17 


13 


11 


9 


4 


2 


2 


0.85 


!)03 


238 


111 


65 


44 


32 


25 


20 


16 


14 


5 


3 


3 


O.flO 


1381 


363 


169 


100 


67 


49 


37 


30 


25 


21 


8 


5 


4 


0.95 


2274 


597 


278 


164 


110 


80 


61 


49 


40 


34 


12 


7 


5 


0.99 


4549 


1193 


556 


327 


219 


160 


122 


98 


80 


68 


24 


14 


10 



It is also unnecessary to prepare a separate table for the average ex- 
periment time for procedures of type R* since for g = the exact values 
can he obtained by substituting the appropriate value of n in the ex- 
pressions appearing in Table II in the row marked n = °o . For example, 
for n = 2, r = 1 and a = 1 the exact value for g = is 0.500 02/2 = 
0.250 0-j , and for n = 3, r = 4, a = ■» the exact value for g = is 
4.000 0,/3 = 1.333 0o . It should be noted that for procedures of type R 2 
we need not restrict our attention to the cases r ^ n but can also con- 
sider r > /; . 

Table III shows the value of r required to meet the specification 
(a*, P*) with a procedure of type R> for various selected values of a* 
and P*. 



PROCEDURES OF TYPE R 3 — SEQUENTIAL, REPLACEMENT 

Let D(l) denote the absolute difference between the number of fail- 
ures produced by the two processes at any time t. The sequential pro- 
cedure is as follows: 

"Stop the test as soon as the inequality 

In [P*/(l - P*)] 



D{t) ^ 



In a 



(3) 



is satisfied. Then select the population with the smaller number of fail- 
ures as the better one." 

To get the best results we will choose (a*, P*) so that the right hand 
member of the inequality (3) is an integer. Otherwise we would be operat- 
ing with a higher value of P* (or a smaller value of a*) than was specified. 
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Table IV — Average Experiment Time and Probability of a 

Correct Selection — Procedure Type R 3 

(a* = 2, P* = 0.800, g = 0) 

(Multiply each average time entry by 2 ) 



n 


a = 1 


a = 2 


a = oo 


1 


2.000 


2.400 


2.000 


2 


1.000 


1.200 


1.000 


3 


0.667 


0.800 


0.667 


4 


0.500 


0.600 


0.500 


10 


0.200 


0.240 


0.200 


20 


0.100 


0.120 


0.100 


oc 


2.000/n 


2.400/n 


2.000/n 




0.500 


0.800 


1.000 







For example, we might choose a* = 2 and P* = 0.800. For procedures 
of type R 3 the probability of a correct selection is again completely in- 
dependent of n\ here it depends only on the true value of the ratio a. 
The average experiment time depends strongly on n and only to a limited 
extent on the true value of the ratio a. Table IV gives these quantities 
for a = 1, a = 2, and a = <*> for the particular specification a* = 2, 
P* = 0.800 and for the particular value g = 0. 



EFFICIENCY 

We are now in a position to compare the efficiency of two different 
types of procedures using the same value of n. The efficiency of Ri rela- 
tive to R» is the reciprocal of the ratio of their average experiment time. 
This is given in Table V for a* = 2, P* = 0.800, r = 4 and n = 4, 10, 20 
and oo . By Table I the value P* = 0.800 is not attained for n < 4. 

In comparing the sequential and the nonsequential procedures it was 
found that the slight excesses in the last column of Table I over 0.800 

Table V — Efficiency of Type Ri Relative to 

Type R 2 

(a* = 2, P* = 0.800, r = 4, g = 0) 



» 


a = 1 


a = 2 


a = oo 


4 
10 
20 

co 


0.501 
0.837 
0.925 
1.000 


0.495 
0.836 
0.917 
1.000 


0.480 
0.835 
0.922 
1.000 
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Table VI — Efficiency of Adjusted R x Relative To R 3 
(a* = 2, P* = 0.800, g - 0) 



« 


a = 1 


a = 2 


«=» 


4 
10 
20 

oo 


0.615 

0.754 
0.818 
0.873 


0.575 

0.708 
0.768 
0.822 


0.419 
0.528 
0.573 
0.612 



had an effect on the efficiency. To make the procedures more comparable 
the values for r = 3 and r = 4 in Table I were averaged with values p 
and 1 — p computed so as to give a probability of exactly 0.800 at a = a*. 
The corresponding values for the average experiment time were then 
averaged with the same values p and 1 — p. The nonsequential pro- 
cedures so altered will be called "adjusted procedures." The efficiency 
of the adjusted Ri relative to R 3 is given in Table VI. 

In Table VI the last row gives the efficiency of the adjusted procedure 
R« relative to R 3 . Thus we can separate out the advantage due to 
the replacement feature and the advantage due to the sequential fea- 
ture. Table VII gives these results in terms of percentage reduction of 
average experiment time. 

We note that the reduction due to the replacement feature alone is 
greatest for small n and essentially constant with a while the reduction 

Table VII — Per Cent Reduction in Average Experiment Time 

due to Statistical Techniques 

(a* = 2, P* = 0.800, g = 0) 



a 


n 


Reduction clue to 

Replacement 

Feature Alone 


Reduction due to 

Sequential 

Feature Alone 


Reduction 

due to both 

Replacement 

and Sequential 

Features 




4 


2! 1.5 


12.7 


38.5 


1 


10 


13.7 


12.7 


24.6 


20 


6.3 


12.7 


18.2 




X 


0.0 


12.7 


12.7 




4 


30.1 


17.8 


42.5 


2 


10 


13.9 


17.8 


29.2 


20 


6.6 


17.8 


23.2 




cc 


0.0 


17.8 


17.8 




4 


31.5 


38.8 


58.1 




10 


13.6 


38.8 


47.2 




20 


6.3 


38. S 


42.7 




30 


0.0 


38 . 8 


38.8 
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due to the sequential feature alone is greatest for large a and is inde- 
pendent of w. Hence if the initial sample size per process n is large we 
can disregard the replacement technique. On the other hand the true 
value of a is not known and hence the advantage of sequential experi- 
mentation should not be disregarded. 

The formulas used to compute the accompanying tables are given in 
Addendum 2. 
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Addendum 1 

In this addendum we shall consider the more general problem of select- 
ing the best of k exponential populations treated on a higher mathemati- 
cal level. For k = 2 this reduces to the problem discussed above. 

DEFINITIONS AND ASSUMPTIONS 

There are given k populations n t (i = 1 , 2, • • • , k) such that the life- 
times of units taken from any of these populations are independent 
chance variables with the exponential density (1) with a common (known 
or unknown) location parameter g ^ 0. The distributions for the k popu- 
lations are identical except for the unknown scale parameter 6 > which 
may be different for the k different populations. We shall consider three 
different cases with regard to g. 

Case 1: The parameter g has the value zero (g = 0). 

Case 2: The parameter g has a positive, known value (g > 0). 

Case 3: The parameter g is unknown (g ^ 0). 
Let the ordered values of the k scale parameters be denoted by 

0i ^ 0> ^ ■ • • ^ h (4) 

where equal values may be regarded as ordered in any arbitrary manner. 
At any time t each population has a certain number of failures associated 
with it. Let the ordered values of these integers be denoted by r,- = r,(0 
so that 



n s r 2 ^ 



S r* (5) 
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For each unit the life beyond its guarantee period will be referred to 
as its Poisson life. Let L,(0 denote the total amount of Poisson life 
observed up to time t in the population with n failures (i = 1, 2, • • • , k). 
If two or more of the r, are equal, say r» = r, + i = • • • = r i+ j , then we 
shall assign r,- and L,- to the population with the largest Poisson life, 
r, + i and L,-+i to the population with the next largest, • • • , r i+j and Lt+j 
to the population with the smallest Poisson life. If there are two or more 
equal pairs (r,- , L.) then these should be ordered by a random device 
giving equal probability to each ordering. Then the subscripts in (5) as 
well as those in (4) are in one-to-one correspondence with the k given 
populations. It should be noted that L*(t) ^ for all * and any time 
t ^ 0. The complete set of quantities Lt(t) (i = 1, 2, • • • , k) need not 
be ordered. Let a = 61/62 so that, since the 0,- are ordered, a ^ 1. 

We shall further assume that: 

1. The initial number n of units put on test is the same and the start- 
ing time is the same for each of the k populations. 

2. Each replacement is assumed to be a new unit from the same popu- 
lation as the failure that it replaces. 

3. Failures are assumed to be clearly recognizable without any chance 
of error. 

SPECIFICATIONS FOR CASE 1 : Q = 

Before experimentation starts the experimenter is asked to specify two 
constants a* and P* such that a* > 1 and \% < P* < 1 . The procedure 
R 3 = Rain), which is defined in terms of the specified a* and P*, has 
the property that it will correctly select the population with the largest 
scale parameter with probability at least P* whenever a ^ a*. The initial 
number n of units put on test may either be fixed by nonstatistical con- 
siderations or may be determined by placing some restriction on the 
average experiment time function. 

Rule Rz : 

"Continue experimentation with replacement until the inequality 

£ a *-<r«-r i) ^ (i _ p*)/p* (6) 

»'-2 

is satisfied. Then stop and select the population with the smallest num- 
ber of failures as the one having the largest scale parameter." 
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Remarks 

1. Since P* > M then (1 - P*)/P* < 1 and hence no two popula- 
tions can have the same value n at stopping time. 

2. For k = 2 the inequality (6) reduces to the inequality (3). 

3. The procedure R 3 terminates only at a failure time, never between 
failures, since the left member of (6) depends on t only through the 
quantities r<(<). 

4. After experimentation is completed one can make, at the 100P per 
cent confidence level, the confidence statement 

(7) 



< 



S Ui 5= a 



< 



(or di/a* g^ 0,) 



where 6 8 is the scale parameter of the selected population. 



Numerical Illustrations 



1/4 



Suppose the preassigned constants are P* = 0.95 and a* = 19 = 
2.088 so that (1 - P*)/P* = Kg- Then for k = 2 the procedure is to 
stop when r-> — n ^ 4. For k = 3 it is easy to check that the procedure 
reduces to the simple form: "Stop when r a - n ^ 5". For k > 3 either 
calculations can be carried out as experimentation progresses or a table 
of stopping values can be constructed before experimentation starts. 
For k = 4 and k = 5 see Table VIII. 

In the above form the proposed rule is to stop when, for at least one 

Table VIII — Sequential Rule for P* = 0.95, a* = 19 
k = 4 fc - 5 



n — r\ 


ri — r\ 


M — r\ 


5 


5 


9 


5 


6 


6 


6 


6 


6 



r. — n 


t\ — n 


N — n 


n — n 


5 


5 


9 


10 


5 


5 


10 


10 


5 


6 


6 


8 


5 


6 


7 


7 


5 


7 


7 


7 


6 


6 


6 


6 



* Starred rows can be omitted without affecting the test since every integer in 
these rows is at least as great as the corresponding integer in the previous row. 
They are shown here to illustrate a systematic method which insures that all the 
necessary rows are included. 
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row (say row j) in the table, the observed row vector (r% — n , 
rz — f\ , • • • , r k — >'i) is such that each component is at least as large as 
the corresponding component of row j. 

Properties of R.i for k = 2 and g = 

For k = 2 and g = the procedure R 3 is an example of a Sequential 
Probability Ratio test as defined by A. Wald in his book. 5 The Average 
Sample Number (ASN) function and the Operating Characteristics (OC) 
function for R 3 can be obtained from the general formulae given by 
Wald. Both of these functions depend on 0i and 2 only through their 
ratio a. In our problem there is no excess over the boundary and hence 
Wald's approximation formulas are exact. When our problem is put into 
the Wald framework, the symmetry of our problem implies equal proba- 
bilities of type 1 and type 2 errors. The OC function takes on comple- 
mentary values for any point a = di/Oo and its reciprocal 62/81 . We shall 
therefore compute it only for a ^ 1 and denote it by P(a). For a > 1 
the quantity P(a) denotes the probability of a correct selection for the 
true ratio a. 

The equation determining Wald's h function 5 is 

(«*>* + ^!T! = 1 ( 8 ) 



1 + a 1 + a 
for which the non-zero solution in h is easily computed to be 

Ha) = £« (9) 

In a* 

Hence we obtain from Wald's formula (3:43) in Reference 5 

P <«> " ^L-T (10) 

a 8 -f- 1 

where s is the smallest integer greater than or equal to 

S = In [P*/(l - P*)]/ln a* (11) 

In particular, for a = l + , a* and « we have 

P(l+) = i, 2; P ( a *) 2: P*, P(oo) = 1 (12) 

We have written P(l + ) above for lim P(x) as x -» 1 from the right, The 
procedure becomes more efficient if we choose P and a* so that S is an 
integer. Then s = S and P(a*) = P*. 

Letting F denote the total number of observed failures required to 
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terminate the experiment we obtain for the ASN function 

^-*(:-M)fei) fora>i (i3) 

and, in particular, for a = 1, co 

E(F; 1) = s 2 and E(F; <*>) = s (14) 

It is interesting to note that for s = I we obtain 

E(F; a) = 1 for all a ^ 1 (15) 

and that this result is exact since for s = 1 the right-hand member S 
of (3) is at most one and hence the procedure terminates with certainty 
immediately after the first failure. 

As a result of the exponential assumption, the assumption of replace- 
ment and the assumption that g = it follows that the intervals between 
failures are independently and identically distributed. For a single popu- 
lation the time interval between failures is an exponential chance vari- 
able. Hence, for two populations, the time interval is the minimum of 
two exponentials which is again exponential. Letting t denote the 
(chance) duration of a typical interval and letting T denote the (chance) 
total time needed to terminate the procedure, we have 

E(T; a, ft) = E(F; a)E(r; a, ft) = E(F; a) (^j (jZ^) (16) 
Hence we obtain from (13) and (14) 

W, a, *) - S - 2 -£, 4^4 f0ra>1 (17) 

n a — 1 a' + 1 

E{Ti 1, ft) = d 4- and B(T; »» *> = — < 18 > 

For the numerical illustration treated above with k = 2 we have 

Ha) = i4-, o« 

1 -+- a 4 
p(l+) = l/ 2 - P(2.088) = 0.95; P(oo) = 1 (20) 

B(f;tt) . 4 !i±-|4^-4 fa+jy + i) (21) 

a - 1 a 1 + 1 cr -p 1 

#(F; 1) = 16.0; E(F; 2.088) = 10.2; E(F; ») = 4 (22) 
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E(T; 1, ft) = *h ; E(T; 2.088, ft) = ™* ; 

n n (23) 

W;<x>,ft) = ** 
?i 

For /.' > 2 the proposed procedure is an application of a general se- 
quential rule for selecting the best of k populations which is treated in 
[1]. Proof that the probability specification is met and bounds on the 
probability of a correct decision can be found there. 

CASE 2: COMMON KNOWN g > 

In order to obtain the properties of the sequential procedure R A for 
this case it will be convenient to consider other sequential procedures. 
Let (S = 1/6-2 — l/0i so that, since the 0, are ordered, 0^0. Let us 
assume that the experimenter can specify three constants a*, /3* and 
P* such that a* > 1, /3* > and \-i < P* < 1 and a procedure is de- 
sired which will select the population with the largest scale parameter 
with probability at least P* whenever we have both 

a ^ a* and ^ 0* 

The following procedure meets this specification. 

Rule R 3 ': 

"Continue experimentation with replacement until the inequality 

2 a *-^-^ e - ' Ul ~ Li) ^(l-P*)/P* (24) 

is satisfied. Then stop and select the population with the smallest number 
of failures as the one having the largest scale parameter. If, at stopping- 
time, two or more populations have the same value n then select that 
particular one of these with the largest Poisson life L\ ." 

Remarks 

1. For k = 2 the inequality reduces to 

(r 8 - n) In a* + (L, - U) 0* ^ In [P*/{\ - P*)) (25) 

If g = then L\ = Li for all t and the procedure R 3 ' reduces to R 3 . 

2. The procedure 22/ may terminate not only at failures but also be- 
tween failures. 
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3. The same inequality (24) can also be used if experimentation is 
carried on without replacement, one advantage of the latter being that 
there is less bookkeeping involved. In this case there is a possibility 
that the units will all fail before the inequality is satisfied so that the 
procedure is not yet completely defined for this case. One possibility 
in such a situation is to continue experimentation with new units from 
each population until the inequality is satisfied. Such a procedure will 
terminate in a finite time with probability one, i.e., Prob{!T > T ] — > 
as To — » °° , and the probability specification will be satisfied. 

4. A procedure fit' (fti , fit , • • • , n* , fi , fc , * " , t k ) using the same 
inequality (24) but based on different initial sample sizes and/or on 
different starting times for the initial samples also satisfies the above 
probability specification. In the case of different starting times it is 
required that the experimenter wait at least g units of time after the last 
initial sample is put on test before reaching any decision. 

5. One disadvantage of R 3 is that there is some (however remote) 
possibility of terminating while n = r 2 . This can be avoided by adding 
the condition r 2 > n to (24) but, of course, the average experiment time 
is increased. Another way of avoiding this is to use the procedure R 3 
which depends only on the number of failures; the effect of using R 3 
when g > will be considered below. 

6. The terms of the sum in (24) represent likelihood ratios. If at any 
time each term is less than unity then we shall regard the decision to 
select the population with n failures and L\ units of Poisson life as opti- 
mal. Since (1 — P*)/P* < 1 then each term must be less than unity at 
termination. 

Properties of Procedure R 3 for k = 2 

The OC and ASN functions for R 3 will be approximated by comparing 
R 3 ' with another procedure R 3 " defined below. We shall assume that P* 
is close to unity and that g is small enough (compared to 2 ) so that the 
probability of obtaining two failures within g units of time is small 
enough to be negligible. Then we can write approximately at termination 

Li g*nT - ng (i = 1, 2, • • • , k) (26) 

and 

L: - Li ^ (n - n)g (i = 2, 3, • • • , fc) (27) 

Substituting this in (24) and letting 

5* = a* £*" (28) 

suggests a new rule, say R 3 " , which we now define. 
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Rule R 3 " 

"Continue experimentation with replacement until the inequality 

2 5*- (r *- r,) ^ (1 - P*)/P* (29) 



is satisfied. Then stop and select the population with r\ failures as the 
one with the largest scale parameter." 

For rule R- A " the experimenter need only specify P* and the smallest 
value 8* of the single parameter 

g = ft eO ((l/9 2 )-(l/0,)) = ae 0P ( 30) 



that he desires to detect with probability at least P*. 

We shall approximate the OC and ASN function of R" for k = 2 
by computing them under the assumption that (27) holds at termina- 
tion. The results will be considered as an approximation for the OC and 
ASN functions respectively of R/ for k = 2. The similarity of (29) 
and (6) immediately suggests that we might replace a* by 5* and a by 
8 in the formulae for (G). To use the resulting expressions for R/ we 
would compute 8* as a function of a* and /3* by (28) and 5 as a function 
of a and /3 by (30). 

The similarity of (29) and (6) shows that Z n (defined in Reference 5, 
page 170) under (27) with g > is the same function of 8* and 5 as it 
is of a* and a when g = 0. To complete the justification of the above 
result it is sufficient to show that the individual increment z of Z n is the 
same function of 5* and 8 under (27) with g > as it is of a* and a 
when g = 0. To keep the increments independent it is necessary to as- 
sociate each failure with the Poisson life that follows rather than with 
the Poisson life that precedes the failure. Neglecting the probability 
that any two failures occur within g units of time we have two values for 
z, namely 

^_ -(nt-o)lBi -ntl6 2 

z = log^ = -logs (31) 

n ( nl -g)ie„ -nt/$i 

and, interchanging 0i and 6-> , gives z = log 8. Moreover 
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Jg Jg 62 



Prob \z = -log 5 1 = 



6-i „- ff [* 2 (n-l)+«in]/Wa _i_ ?} a -o»2»-Wi(»-l)]/*i«s) 



~ e ~ e (32) 



= 5 
" l + « 

Thus the OC and ASN functions under (27) with r/ > bear the same 
relation to 8* and 5 as they do to a* and a when g = 0. Hence, letting 
w denote the smallest integer greater than or equal to 

In [P*/(l - P*)] __ ln[P*/(l-P*) ] , 

In 5* 0/3* + In a* 

we can write (omitting P* in the rule description) 

P{8; R 8 ' (a* /3*)) » P{«5 «/(«*)) = ^3 (34) 



for 5 > 1 (35) 



1<J\F;R,' («*,P*)}^VIF;R 3 "(8*)\ 

to 2 for 5=1 

We can approximate the average time between failures by 

E[T . e t ,e,, fJ ) = %±^>-?£ * + £ (nr-) (36) 

n(0i + 2 + 2g) n \1 + a/ 

and the average experiment time by 

BIT; *V. «) - *W 8.V, *•)] |^;t+^i (37) 

Since 5 = J then 5 ,r /(l + 5"') is an increasing function of w and by 
(33) it is a non-increasing function of 8*. By (28) 5* = a* and hence, 
if we disregard the approximation (34), 

\p*/(\ — p*\\ ln Slln a * 
P\8; &*(«*)] <* ! J tpl^lp^in ./,.,> = P{W(«*)J (38) 

Clearly the rules P 3 (a*, P*) and P 3 " ("*, P*) are equivalent so that 
for g > we have 

P{5;fl 3 (a*)J -Pfl; «/(«*•)) (39) 
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and hence, in particular, letting 8 = 8* in (38) we have 

P{5*;fi 3 (a*)} ^ P{8*;R 3 "(8*)} ^ P* (40) 

since the right member of (34) reduces to P* when W is an integer and 

5 = 8*. The error in the approximations above can be disregarded when 
g is small compared to 02 . Thus we have shown that for small values of 
g/02 the probability specification based on (a*, /3*, P*) is satisfied in the 
sense of (40) if we use the procedure Rs(a*, P*), i.e., if we proceed as if 

g = o. 

It would be desirable to show that we can proceed as if g = for all 
values of g and P*. It can be shown that for sufficiently large n the rule 
Rsia*, P*) meets it specification for all g. One effect of increasing n 
is to decrease the average time E{r) between failures and to approach 
the corresponding problem without replacement since g/E(r) becomes 
large. Hence we need only show that Rs(a*, P*) meets its specification 
for the corresponding problem without replacement. If we disregard the 
information furnished by Poisson life and rely solely on the counting of 
failures then the problem reduces to testing in a single binomial whether 

6 = 0i for population IIi and = 2 for population n 2 or vice versa. Let- 
ting p denote the probability that the next failure arises from I7i then 
we have formally 

Ho:p = - — : — versus H\vp — 



1 + a r 1 + a 

For preassigncd constants a* > 1 and P* { x /$ < P* < 1) the appropri- 
ate sequential likelihood test to meet the specification: 

"Probability of a Correct Selection ^ P* whenever a ^ a*" (41) 
then turns out to be precisely the procedure 7? 3 (a*, P*). Hence we may 
proceed as if g = when n is sufficiently large. 

The specifications of the problem may be given in a different form. 
Suppose 0i* > 2 * are specified and it is desired to have a probability of a 
correct selection of at least P* whenever 0i ^ 0i* > 2 * ^ 02 . Then we 
can form the following sequential likelihood procedure R 3 * which is 
more efficient than Rtfa*. P*). 



"Continue experimentation without replacement until a time t is 
reached at which the inequality 

Sb^rJ =-p*~ (42) 
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is satisfied. Then stop and select the population with n failures as the 
population with = 0i". 

It can be easily shown that the greatest lower bound of the bracketed 
quantity in (42) is 0i*/6 2 *. Hence for 9i*/6 2 * = a* and P* > % the time 
required by 2iV(0i*, 02*, P*) will always be less than the time required 
by# 3 (a*,P*). 

Another type of problem is one in which we are given that = 0i* 
for one population and = 2 * for the k - 1 others where 0i* > 2 * are 
specified. The problem is to select the population with = 0i*. Then 
(42) can again be used. In this case the parameter space is discrete with 
k points only one of which is correct. If Rule R 6 * is used then the 
probability of selecting the correct point is at least P*. 

Equilibrium Approach When Failures Are Replaced 

Consider first the case in which all items on test are from the same 
exponential population with parameters (0, g). Let T n j denote the length 
of the time interval between the j th and the j + 1 st failures, (j = 0, 
1, • • • ), where n is the number of items on test and the th failure de- 
notes the starting time. As time increases to infinity the expected number 
of failures per unit time clearly approaches w/(0 + g) which is called the 
equilibrium failure rate. The inverse of this is the expected time between 
failures at equilibrium, say E{T„J. The question as to how the quanti- 
ties E(T n j) approach E(T n J is of considerable interest in its own right. 
The following results hold for any fixed integer n ^ 1 unless explicitly 
stated otherwise. It is easy to see that 

E(T„i) ^ E(T n J ^ E(T n0 ) (43) 

since the exact values are respectively 

I- 6 )£l±lzo+l (44) 



n — 1 \ n J n n 

In fact, since all units are new at starting time and since at the time of 
the first failure all units (except the replacement) have passed their 
guarantee period with probability one then 

E(T ni ) ^ E{T nj ) ^ E(T n0 ) (j ^ 0) (45) 

If we compare the case g > with the special case g = we obtain 

E(TJ ±i (j m 1,2, .-.) (46) 

n 
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and if we compare it with the non-replacement case (g/9 is large) we 
obtain 



E{T ni ) ^ 



U = 1, 2, 



-1). (47) 



n - j 

These comparisons show that the difference in (4G) is small when g/8 is 
small and fovj < n the difference in (47) is small when g/0 is large. 

It is possible to compute E(T nj ) exactly for g ^0 but the computa- 
tion is extremely tedious for j ^ 2. The results for j = 1 and are given 
in (44). Fori = 2 



E(Tra) = 



n - 2 



" (n + 2)(n - 1) - ln -Qgi$ 

1 « & 



, n — 2 ( n _D 0/ 
n — 1 



n ~ 2 _2(n-l)o/fl 

v?(n - 1) 



(48) 



(to > 2) 



and 



E(Tv) - g - % [1 - 4<r c/fl + e- 2 " 9 ] 



(49) 



For the case of two populations with a common guarantee period g 
we can write similar inequalities. We shall use different symbols a, b for 
the initial sample size from the populations with scale parameters 0i , 2 
respectively even though our principal interest is in the case a = b = n 
say. Let T a ,b.j denote the interval between the j ih and j + 1 st fail- 
ures in this case and let X, = 1/0, (i = 1,2). We then have for all values 
of a and b 

[aX, + to..] -1 ^ E(TaXj) ^ E(T aX0 ) 



= g + [oXi + 6X 2 ] l (j = 0, 1, 2, 
> (0! + fir) (02 + g) 



, ») (50) 

a(0 2 + gr) + b(0i + j;) (51) 

The result for E(T a ,b,i) corresponding to that in (43) does not hold if 
the ratio 0i/0 2 is too large; in particular it can be shown that 



« 7 '-> " (eTJkXst 



1 



+ 



- l)Xi + b\J _ 

1 
aXi + bXi/VaXi + (6 — 1)X 2 y |_ 



1 - 



Xic 



-B[(a-l)Xi+6X 2 ]' 



aXi + 6X 2 



6X2 



1 - 



X 2 f' 



,-«[aXi+(6-l)W]- 



(52) 



aXi -f- 6X 2 



is larger than E(T a , b ,J for a = b = 1 when <//0i = 0.01 and g/8 2 = 0.10 
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so that di/02 = 10. The expression (52) reduces to that in (44) if we set 
0! = 2 = e and replace a and b by w/2 in the resulting expression. 

Corresponding exact expressions for E(T a , bJ ) fori > 1 are extremely 
tedious to derive and unwieldy although the integrations involved are 
elementary. If we let gr — > «> then we obtain expressions for the non- 
replacement case which are relatively simple. They are best expressed 
as a recursion formula. 



^^-setk "•**** 



aXi + oX 2 



iHia,6li; a\!+ 6X 2 (a- l)Xi+ &X2 



+ ^! J — (a, 6 > 1) 

T aXi + 6X 2 aXi + (b - 1)X 2 



(53) 



(54) 



E(Tafi,i) ^ 9 + i/« for i = a and J = ° ^ 55) 

E(T a ,o,i) = Oi/ia-j) for 1 £ j £ a - 1 (56) 

Results similar to (55) and (56) hold for the case a = 0. The above 
results for g = » provide useful approximations for E(T a ,b,j) when 
is large. Upper bounds are given by 

B(r fl .6.,) ^ [aXi + (b - j)\2f l (j = 1, 2, ■ • • , 6) (57) 

E(T a xi+>) ^ [(a - j)Xj -1 (j = 1, 2, • • • , a - 1). (58) 

Duration of the Experiment 

For the sequential rule R a ' with k = 2 we can now write down approxi- 
mations as well as upper and lower bounds to the expected duration 
E(T) of the experiment. From (50) 



c-l 



+ [E(F; 8) - c)E(T n , n , e ) 

where c is the largest integer less than or equal to E(F; S). The right ex- 
pression of (59) can be approximated by (53) and (54) if g is large. If 
c < 2n then the upper bounds are given by (57) and (58). A simpler 
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upper bound, which holds for all values of c is given by 

E{T) =g E(F; S)E(T n , n ,„) = E{F; 8) (g + 6 A (60) 

CASE 3: COMMON UNKNOWN LOCATION PARAMETER Q ^ 

111 this case the more conservative procedure is to proceed under the 
assumption that g = 0. By the discussion above the probability require- 
ment will in most problems be satisfied for all g ^ 0. The OC and ASN 
functions, which are now functions of the true value of g, were already 
obtained above. Of course, we need not consider values of g greater than 
the smallest observed lifetime of all units tested to failure. 

Addendum 2 

For completeness it would be appropriate to state explicitly some of 
the formulas used in computing the tables in the early part of the paper. 
For the nonsequential, nonreplacement rule Ri with k = 2 the proba- 
bility of a correct selection is ■ 

P(a; Zfc) = [ f f r {y, e 2 )f r (x, 60 dy dx (61) 

JO •'() 

where 

Mx, 6) = 7 - C r n (l - c-'T 1 e- x{n -' +1)IB . (r ^ n) (62) 

V 

and C" is the usual combinatorial symbol. This can also be expressed in 
the form 

p(a-, a) = i - (rc:r i: ( ~°V . 

,-i n - r + j (63 ) 

CT-WBlr, n - r + 1 + «(w - r + j)]}" 1 

where B[x, y] is the complete Beta function. Equation (66) holds for 
any g ^ 0. 

For the rule Ri the expected duration of the experiment for k = 2 
is given by 

E{T) = r x{f r (x, 0OU - F r {x, d 2 )] + f r (x, d 2 )[l - F T (x, dt)}} dx (64) 

where f r (.r, 6) is the density in (62) and F r (x, 0) is its c.d.f. This can 
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also be expressed in the form 



plus another similar expression in which X , a are replaced by 2 , a 
respectively. For g > we need only add g to this result. This result 
was used to compute E(T) in table 1A for a = 1 and a = 2. For a = «> 
the expression simplifies to 

*(r>-^?±^ (n ( .~;+'ir (66) 

which can be shown to be equivalent to 

E(T) = B 2 ± l -r—-. : (67) 
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